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Set Books 


D. L. Kreider, R. G. Kuller, D. R. Ostberg and F. W. Perkins, An Intro- 
duction to Linear Analysis (Addison-Wesley, 1966). 
E. D. Nering, Linear Algebra and Matrix Theory (John Wiley, 1970). 


It is essential to have these books; the course is based on them and will 
not make sense without them. 


Conventions 


Before working through this correspondence text make sure you have 
read An Introduction to the Bridging Material and A Guide to the Linear 
Mathematics Course. 


The set books are referred to as: 
K for An Introduction to Linear Analysis 
N for Linear Algebra and Matrix Theory 
Note 


This bridging material is not based on the set books. It has been written 
especially for the benefit of students who have taken the Mathematics 
Foundation Course M101 (The Open University Press, 1978) 

References to this foundation course take the form M101 Block V Unit 2 


1.0 INTRODUCTION 


Many problems in applied mathematics require, for a complete solution, 
the specification of a function. As a relatively straightforward example, 
imagine that you have a coil spring, one end of which is fixed, and that 
you suspend from the other end a weight (such as £1’s worth of copper 
coins!) Imagine further that you pull down on the weight, and then 
release it. During the subsequent motion, the weight will bob up and 
down: the problem is to predict as accurately as possible, from a 
knowledge of characteristics of the spring and the weight, and of the 
physical laws which apply to such a system, the motion of the weight. 
This motion can best be described by a function, the function which gives 
the distance of the weight, below a suitable fixed point on the axis of the 
spring, in terms of the time elapsed since the weight’s release. 


In this case, as in those dealt with in M101 Block V Unit 2, the information 
from which the unknown function is to be found consists of a differential 
equation that it has to satisfy. That is, the information takes the form of 
a relation that must hold between one (or several) of the function's 
derivatives, and the function itself. To be explicit, the distance function 
must have the property that its second derived function, when added to 
the function itself, gives zero, i.e. ` 


f"+f=0 

where f is the distance function. 

That is to say, for every time t (after the moment of release) we must have 
L(+ se) =o. 


(This differential equation is a consequence of the law governing the 
motion of a body which says that the body’s acceleration is proportional 
to the force acting on it. The acceleration at time t is f”(t); the force in 
this case happens to be proportional to-f(t); when the constants of 
proportionality take suitable values, and the direction in which the force 
acts is taken into account, the differential equation above is the result. 
The details-of the derivation need not concern us.) 


Differential equations arise in many different situations. One activity 
which very often leads to a differential equation is the modelling of a 
time-dependent system, where a rule governing the rate of change of some 
quantity is known, and the problem is to determine the quantity’s 
dependence on time explicitly. Dynamical problems like the spring 
problem described above lead to differential equations because the law 
of motion determines only acceleration. Some purely geometrical prob- 
lems lead to differential equations—for example, one might want to 
determine all curves whose tangents had some special property. 


1.1 SOLUTIONS OF DIFFERENTIAL EQUATIONS 


1.1.1 First steps 


Having established the importance of differential equations, we turn now 
to begin to study them in their own right. To start with, here are some 
more examples of differential equations: 


F'(t)= 2t (1) 
U'(t) = —AU(t) (2) 
a. au (3) 
way? (4) 
Oya y=0 (5) 
ae By = 3x3, (6) 


Here are some points to note about these examples. 


First, there is a lot of latitude in the notation we use for differential 
equations. We can use primes to denote derivatives, as in examples (1) 
and (2), or we can use Leibniz’ notation as in the other examples. 

d? 
In fact, in example (5) we have simplified the expression -— (y), 


dx? 
2 


sai d 
for the second derivative of y, to the form — Similarly we shall denote 


ae d™ r r 
the mth derivative by TA We shall often refer to the derived function 
ax 
as the derivative, for brevity, as does the set book K. 


The same differential equation may appear in quite different guises, as in 
examples (2) and (3). We can even change letters without changing the 
essential meaning ofa differential equation: as you have probably realized, 
the list of examples includes the equation that introduced this discussion. 
For the remainder of this section we shall use the form of writing 
differential equations of which (4), (5) and (6) are examples. 


Ags a second point, note that the differential equation may include not 
only the unknown function and its derivatives, but also the ‘dependent 
variable '—either by itself (the 2¢ in example (1), the 3x3 in example (6)) 
or multiplying a derivative (the 2x in example (6)). 


Third, note that example (5) differs from all the others in that it involves 
the second derivative while the others only involve the first. We describe 
this difference by calling examples (1}-(4) and (6) first-order differential 
equations, and example (5) a second-order differential equation. The order 
ofa differential equation is the order of the highest derivative that occurs 
in it. Thus 


d'y d 
ekri yyap 


dx? dx 


is a second-order equation, 


diy dy 

sa tocatsinx =0 

dx* dx? 

is a fourth-order one. The same terminology is used even when the 
derivative occurs in some more complicated fashion: 


dy\? 7 
(Z= 


is a first-order differential equation, even though the derivative is squared. 
(Equations like this, however, will not appear very often in this course.) 


The main point of studying differential equations is to solve them. To 
solve a differential equation is to find a function (or functions) of x, 
which, when it is substituted for y (and its derivatives are substituted for 
dy dy F s F 

z, pea . . as necessary) causes the equation to be satisfied. It is occa- 
sionally possible to do this by guesswork: for example, a knowledge of 
the derivatives of the sine and cosine functions immediately suggest that 


y = sin x, (whose derivative is discussed in M101 Block III 
Unit 1, Section 1.2) 


is a possible solution of the differential equation 


d’y 

= =0. 

dx? ty 
It is a straightforward matter to check that it is a solution: 

‘ ; d d? . 

if y = sin x, then > = cos x, and T = —sin x, 
so 

d’y 


gy7 + Y= (~sin x) + sin x = 0. 


It is equally easy to check that 
y =.cos x 
is also a solution of this equation—and that so are 
y=sinx +cosx 
y=2sinx 
y=2sinx +3cosx 
and, indeed, so is 
y=asinx + bcosx 
for any constants a and b. 


This is the first indication of a general truth; that a differential equation 
may have many solutions—and by that we don’t mean tens or hundreds, we 
mean so many that one cannot count them. Each choice of the values 
of the numbers a and b in the formula above gives a solution of the 
differential equation. As it happens, every solution of the equation can 
be obtained by making an appropriate choice of a and b. So in this case, 
at least, we can be said to have solved the equation completely by the 
formula 


y=asinx + b cos x. 


There are many interesting types of differential equation for which a 
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complete solution, in this sense, can be found. It will be our aim, in 
this course, to describe some of them and their solutions. 


Guesswork, the “method” we used above, is clearly not the most 
satisfactory method of solving differential equations. (If you don’t believe 
this, try guessing a solution of say 


Systematic methods would be preferable, and we shall describe some 
below, and later in the course. But we should first make it clear that 
there is no one systematic method for solving all differential equations 
(as there is one systematic method for solving all quadratic equations 
in algebra, for example). Instead, one has to pick out certain types of 
differential equation, and develop a separate method for each type. 


The simplest type of differential equation is exemplified by the equation 


dy N 
mn 


(compare with example (1) above!). Here the derivative of the unknown 
function is simply specified, as a function of x. In other words, the 
differential equation says that the unknown function is a primitive of 2x. 
Solution of this differential equation amounts to antidifferentiation, and 
we obtain 


y=x +e 


where c is a constant. Note that putting in the constant of integration, 
c, is again a way of admitting that there are many solutions to the 
equation. 


You should find it easy to recognize differential equations of this simple 
type—and to solve them, at least if you can carry out the integration. 
The point of mentioning this type of equation is that in the last analysis, 
integration is the only method we have for finding explicit solutions of 
differential equations. All other methods are really methods of getting the 
equation into a form in which integration will lead to the required 
solution. (This ignores, of course, the possibility of finding approximate 
solutions by graphical or computational methods—a most important 
branch of the subject, but not one we are immediately concerned with.) 


From this point of view we can understand, albeit very crudely, where 
those constants a and b in the solution 


y=asinx + b cosx 
of the differential equation 
d?y 


ai ty=0 


come from: they are in some sense ‘constants of integration’, and there 
are two of them because it takes two integrations to undo the two 
differentiations built into this second-order equation. 


Before going on to describe some methods of solving some more compli- 
cated first-order differential equation, let us summarize the story so far. 


A differential equation is an equation involving an unknown function, 
its derivatives, and the dependent variable. Such equations are of frequent 
occurrence in applications of mathematics. The order of a differential 
equation is the order of the highest derivative it contains. A solution of 


+ 

a differential equation is a function which satisfies the equation: when 
the function’s derivatives are computed and substituted into the equation, 
together with the function itself if necessary, the equation is satisfied. It 
cannot be emphasized too strongly that the solution of a differential 
equation is a function. The simplest kind of differential equation is one 
in which the unknown function’s derivative is specified in terms of x. 
Such an equation is solved by direct integration. Other differential 
equations must also be solved by integration, but indirectly. 


Exercises 


1. Solve the differential equation 
d. 
Z =sinx +x. 


2. Find the solution of the equation 


d?y 
ae +y=0 
that also satisfies y(0) = 1 and (5) =1. 
Solutions 
x? 
1. The function y= — cosx + 7 +c is a primitive for 


sin x + x, where c is an arbitrary constant of integration. 
Hence this function y is a solution of the given differential 
equation. 


2. A typical solution of the equation is 
y=asinx + bcosx, 
where a, b are constants. 


Now y(0) = a.0 + b.1 = b 
and 3] =al+b0=a 


- So the solution 
y= sin x + cos x 


is obtained by setting a = b = 1. 


1.1.2 Separation of Variables 


We begin by reviewing a method of solving certain first-order differential 
equations which was discussed in M101 Block V Unit 2. It is called the 
method of separation of variables. We start with a simple example. 
Consider the equation 


dy 
dx 


Assuming that y is not zero for any value of x, we may rewrite this 
equation as 


aN ae 
ydx 


+ day =0, where A is a constant. 


The left hand side of this equation is in fact a derivative of a function of 


y, the 2 term arising from the application of the chain rule: 
x 
d 1dy 
i (log. y) = Jax 


(The differentiation of log, was discussed in M101 Block III, Unit 5 
Section 5.4.) 


Thus the equation may be written as 


d 
gy lobe y= A 


and its solution reduces to a very straightforward integration: 


log. y = Í (--A}dx = —àx +c, (eisa constant), 


whence 


=ìàx+e ax 


y=e =ae™, 


where a = e° is another constant. (Strictly speaking if a = ef then a must 
apparently be positive. However a more careful analysis shows that our 
method implicitly assumes that y is always positive; it may easily be 
modified to include the negative solutions, which take the same form 
but with a negative; the zero function is also a solution, and this is 
included in the general solution y = ae~* as the case a = 0.) 


Before continuing with differential equations we must make a brief aside 
here about logs. In the calculations above we have used the notation 
log, for the natural logarithm function (log to base e). This was the 
notation used in M101. However, in M201 the alternative notation In is 
used for this function (because it is used in K); so we shall adopt this 
notation from now on. 


The method we used for solving the differential equation y +4y=0 
x 


may be adapted for use in quite a large class of first order equations. 
The equations to which it applies are those of the form 


Z 4-6) av) =0, 


where fand g are any two functions. In our example above these functions 
were particularly simple: 


»  f()=2 gp)=v. 
But the method would also apply to 


dy A 
a 5 
az 
dx y ” 


OY edna st 
ad n = 
dx tnx sin y= 0, 


-for example. It would not however apply to 


dy . 
i sin(xy) = 0. 


In the general case 

dy 

dx t J) 9) =9 
it works like this. We separate the variables by rewriting the equation 
in the form 

1 dy 
sr = —S (x). 
goja Ae 


The left-hand side does not involve x explicitly, the right hand side 
involves x alone. The variables can thus be said to be separated. 


In the particular case we described above we were able to express the 
left hand side as the derivative of a function of y, that is, as the 

oe : 5 d. È x 
derivative of a composite function, the z term coming from the chain 
rule. To do this in the general case, we have to find a primitive of the 
left hand side, that is, evaluate the indefinite integral 


But by the substitution rule, (M101 Block III Unit 3, Section 3.5) this is 
the same as 


1 


| a0) dy, 


which can be evaluated (in principle, at any rate) since g is a known 
function. We are then in the happy position of having an equation of 
the form 


d ; 
Te (something) = — f(x), 


which can be solved by a further integration. It remains only to solve 
the resulting equation algebraically for y. 


In fact the method in practice is very simple: to find the solution of 
2 + ss) a) =0, 

one simply rewrites it as 
[ay = [ises 
Sg) 

evaluates the integrals, and solves the result algebraically for y. 


Example 


Solve the equation 


Solution 
On separation of the variables, the equation becomes 


dy 
Iie ~ 


ll 


This is equivalent to 


[ydy= [xax 
so that 
Lil, 
grat te 
or 
y=./x? +d, where d is a constant. 


(Ofcourse, d = 2c—but it makes no difference, in picking out a particular 
solution, whether we have to specify the value of d or of 2c.) 


It is worth emphasizing here that it is always a good habit to check the 
correctness of a solution of a differential equation by substitution in the 
equation. In this case, 


i dy 1 1 x 
if y = /x? + d, then = = => 2x x 
4 dx 2 fx? 4d Jx} +d 


and so 
dy x x __ x 
dx y Jxttd x? +d 


So we have succeeded in producing a solution. 


0. 


Exercises 
1. Solve the equation 


dy y 
aoe 


(assuming x and y are always positive). 


2. Find a solution of 


dy 1 
dx y °° 
for which 


Solutions 


1. Separating the variables we find 


ty ix 


ea 


> 


so integration gives 

Iny=Inx+e, for some constant c. 
Using properties of In we find 

y=kx, 
where k is the constant such that In k = c. 


2. Separating the variables we find 


[ ydy = fax, 


12 


so integration gives + 
ty? =x+c, for some constant c. 
Hence 
y= f2x + 2c 


and since we require that y(1) = /2 the solution we seek is 
y= 2x. 
1.1.3 Integrating Factor Method 


An important case of a separable variables equation is of the form 


dy 

SY 4 P(x)y = 0, 

ax + Plely = 0 (1) 
where P(x) is a specified function. To solve this equation, we separate 
the variables, to obtain 


[2- - | P(x)dx + A 
1.6, 
Injy| = - | P(xdx +A 


or y=Ce Pes (where In |C| = A). 

So that a solution to (1) is C = yel?™)4, 

Why did the modulus sign appear in part of our solution? Well, the 
function In x is only defined for positive value of x, so if y takes negative 
values the function In y is not defined. However, in this case In(—y) is 


defined, since (— y) takes positive values. In either case, In|y| is always 
defined since the modulus of a number is always positive. 


Now if y is positive we know 


d d 1 dy 
ix OM) = ge nV ae 


But also if y is negative we find 


d 1/ dy\ lay 
In(—y))= 2 say 
top- £ t(-yy=2(-2)= 22 
: a ldy 
Hence In |y| is always a primitive for cde and 
ridy dy _ 
yaa lFr eb 


Fortunately at the next stage in the argument the sign of y is incor- 
porated into the constant C and so we can dispense with the modulus ||. 


Equation (1) is a special case of the equation 


F + PW = Ox), Q) 


for which Q(x) = 0. 


If Q(x) #0 is a known function, we can multiply (2) by an integrating 
factor; it is 


elpa 


We do this so that the left-hand side of the differential equation then 
becomes a derived function of a product. 


Indeed (2) becomes 


g! Piside dy +e Pods P(x)y =e! PlrideO(x) 
dx i 


which can be written as 


n (ye! Pewa) = e rodo (x) 
ax 


Integrating, we obtain 
syed Pexidx — fe PdO (x)dx + C 
or 


y= (fe PaO (y)dx + c) «ga Í Plaids 


This is a very complicated expression, so here are some examples. 


Example 


dy ) 
Solve 2 z + 42 = 8x, given that y = 2 when x = 1. 


Solution 


This equation will be in the form (2) if the coefficient of (2) is 1. 
x 
So on dividing by 2, we can write the equation as 


d 
Y yalay, 
dx x 


2 
Now P(x) = z and Q(x) = 4x and f P(x)dx = In x?. 


The integrating factor is 
el P(x)dx = gins? i x?, 
Multiplying the equation by the integrating factor, we obtain 


e dy 
2 i= 4y 
x Ix + 2yx = 4x?, 


= (xy) = 4x3. 

On integrating, we find 
y=xt +C. 

Since y = 2 when x = 1, we find 


2=1+C, and hence C = 1. 


The required solution is 


1 
= tx 
y=ztx 


Example 
Solve the equation 


ytanx+y=4sinx, for xe ]0, af 


given that y = 2/2 when x = Z. 


Solution 

We write the equation in the standard form as 
y + y cot x = 4 cos x, 

so that 


cos x 
dx 


Í P(x)dx = Í cot x dx = f 


/ sin x 
= In|sin x| 


Since sin x is positive in the range we are considering we can drop the 
modulus sign. The integrating factor is therefore sin x. On multiplication, 
the equation is written as 


4 (ysin x) = 4 008 x sin x = 2 sin 2x 
X 


so that 
ysinx =2 Ísin 2x dx +C 


= —cos 2x + C = 2sin? x — 1 +C; 
hence 
c-1 


=2sinx +—_. 
4 sın x 


Since y= 2/2 when x = F we have C =2. 


‘ 1 
It follows that y = 2 sin x + ——. 
sin x 


Exercises 


1. Solve the differential equation 


ee aie = =x, 


given that when x = 0, y = 4. 
2. Solve the equation 


xy +y=xsinx 


: n 
given that when x = p= ile 


Solution 


1. The equation can be written as 


— 6y = —2x 
The integrating factor is 

ef Pixidx — g- 6S dx 9 6x 
Then 

d 

a (ye ®*) = —2xe §, 
so that 


ye" ®* = —2 [xe +C 


ye ee ee 
= -2/ aad 36° Jee 


(on integrating by parts) and 
= 1 1 6x 
Yaa (x + 3] +e. 


When x = 0, y = $ i.e. 


1 T4 5 

373% ete or C= 
Finally, 

A AN Se 

Peal 6)" is 

lfs pox 

=3(e+z+z6 } 


2. We write the equation as 
y+ Z= sin x. 
x 


The integrating factor is ef P94 = e= = x (x > 0). 


Hence 

d : 

ik (xy) = x sin x 
so that 

xy = [xsinx dx = —xcosx+sinx+C. 
Since y = 1 when x = > we have 

T 

7 1+C 


which implies that C = =i 
The solution is 


ut sinx +2 i ci 
y= 2 OS X. 
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1.1.4 Summary of Sections 1.0 and 1.1 


In these sections we defined the terms 


differential equation (page 5) 
order of a differential equation (page 6) 
separation of variables (page 9) 
integrating factor (page 13) 
We introduced the notation 

d'y d'y 

Er A 6 
DE dat (page 6) 
In x . (page 10) 


We discussed four techniques for solving differential equations. They are: 


1. Guesswork (page 7) 
For example, y = sin x is a solution of 

d’y 

oa =0 

met 
2. Integration (page 8) 
An equation of the form 

dy 

Rate) 


can be solved by finding a primitive for f. 


3. Separation of Variables (page 11) 


An equation of the form 


dy 
2E =0 
a t Fay) 
can be solved by this method. 


4. Integrating factor (page 13) 
This method can be used to solve equations of the form 
dy 


at P(x)y = Q(x), using the integrating factor ef Pos, 


1.2 DIFFERENTIAL OPERATORS 


You may very well be wondering at this stage what this work on 
differential equations has to do with vector spaces and linear transfor- 
mations. Some hints that there is a connection have already occurred. 
One is the reference to spaces of functions at various places in the early 
part of the course—as we have been at pains to point out, differential 
equations have very much to do with functions Another is that the 
general solution of the equation 

d? 

oe +y=0 
could be described as the set of all linear combinations of the functions 
sinx and cosx: in other words it is a two-dimensional space of 
functions, which is spanned by sin x and cos x. The set of solutions of 


ay 
dx 


is even easier to describe: it is the one-dimensional subspace of the 
space of differentiable functions, which is spanned by e~?*. The sets of 
solutions of these differential equations are both vector spaces (and it is 
no coincidence that the dimension of the solution space matches the 
order of the equation in each case). 


+iy=0 


To explain in a little more detail what these connections are we shall 
have to make a slight detour, and go back and interpret the operation 
of differentiation from a new viewpoint. How does differentiation fit in 
with function spaces? First of all, one must get used to thinking of 
differentiation as an operation, which can be applied to any suitable 
function, and which results in another function. To emphasize this point 
it is helpful to adopt yet another notation, one which separates the 
symbol for differentiation from the symbol for a function to which it is 
applied. We use D to stand for differentiation, so that the derivative of 
a function f is written 


Df. 


You should think of this as analogous to a linear transformation acting 
on a vector. In fact D is a linear transformation: given any two 
differentiable functions f and g, and constants a and b, 


D(af + bg) = aDf + bDg. 


(This is just a smart way of saying something that you have known 
for ages—the sum rule and constant multiple rule for differentiation.) 


The rules for combining linear transformations, which are discussed in 
early units of M201, apply to linear transformations of function spaces 
just as much as to those on finite-dimensional vector spaces. Thus, 
since multiplication by a constant is a linear transformation (indeed, 
multiplication by a fixed function is a linear transformation on a function 
space), we may form new linear transformations such as 


D+, 
D +1. 


Here D? means DD—apply D twice in succession. Since these are linear 
transformations, their kernels are vector spaces. And what are their 
kernels? The kernel of a linear transformation is the set of vectors which 


+ 


it maps to zero. The kernel of D + 4 is thus the set of functions f such that 


(D+) =0 
or 
Df + if =0. 
But this is just the differential equation 
dy 
x +Ay=0 


in disguise. In other words, solving the differential equation amounts to 
finding the kernel of a linear transformation. The same is true of the 
differential equation 


dy P 
matro: 


the linear transformation in this case is D? + 1. This explains why, in 
these two cases, the set of solutions is a vector space—it is the kernel 
of a linear transformation. 


Not all differential equations by any means, can be described in this 
way. But those that can are especially important, simply because the 
vector space association suggests powerful ways of dealing with them. 
Differential equations which arise from linear transformations formed 
from the D operator in this way are called linear differential equations— 
they are the subject of much enquiry in this course. 


In these remarks we have been deliberately imprecise about exactly which 
function spaces are involved when one discusses the D operator. To put 
the whole matter on a firm footing, one must first of all clear up this 
point; and this is where Unit 4 begins. 


Summary of Section 1.2 


This section defines 


combinations of operators (page 18) 
linear differential equations (page 19) 


It introduces the notation 


D (page 18) 
D? (page 18) 
Df (page 18) 
D+i (page 19) 
D? +1 (page 19) 


This section shows that the set of solutions of a differential equation 
can sometimes be considered as the kernel of a linear transformation. 
Hence they are vector subspaces, and some spanning subsets were ex- 
hibited. 
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